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CONSTITUTION: The image data read from a memory 3 is divided into 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the image processing system which gives texture to an image and is 

reproduced. 

[0002] 

[Description of the Prior Art] Conventionally, in image processing systems expressed only with binary, such as a display and 
an airline printer, in order to express halftone and to give texture to a playback image, false halftone processing of a dither 
method etc. is performed. Moreover, with equipment refreshable at a multiple value, the image of a soft tune can be obtained 
by reproducing a multiple-value dither image. 
[0003] 

[Problem(s) to be Solved by the Invention] This invention aims at offering the new image processing system which can give 

texture to the image which has gradation and can be reproduced. 

[0004] 

[Means for Solving the Problem] A division means to divide image data for every block in a 2-dimensional space field in 
order that the 1st means may attain the above-mentioned purpose, An orthogonal transformation means divided by said 
division means to compute the multiplier for every frequency by carrying out orthogonal transformation of the image data for 
every block, A random-noise addition means to add the random noise for giving fluctuation to an image to the multiplier for 
every frequency computed by said orthogonal transformation means, It is characterized by having a reverse orthogonal 
transformation means to carry out reverse orthogonal transformation of the multiplier to which random noise was added by 
said random-noise addition means, and to restore image data. 

[0005] The 2nd means is characterized by said random-noise addition means adding random noise to the multiplier of the 
whole block computed by said orthogonal transformation means, or a specific frequency range alternatively in the 1st means. 
[0006] A division means by which the 3rd means divides image data for every block in a 2-dimensional space field, A 
calculus-of-finite-differences appearance means divided by said division means to compute the difference of an attention pixel 
and a contiguity pixel for every block, A distributed calculation means to compute in a block distribution of the difference 
computed by said calculus-of-finite-differences appearance means for every block, A block selection means to choose the 
block which adds the random noise for giving fluctuation to an image based on the distribution computed by said distributed 
calculation means, It is characterized by having a random-noise addition means to add random noise to the pixel of the block 
chosen by said block selection means. 

[0007] The 4th means is characterized by computing the difference of an attention pixel and a contiguity pixel in the 3rd 
means by computing a prediction error with a true value by computing the forecast of the attention pixel which said 
calculus-of-finite-differences appearance means computes correlation from the plane region of an attention pixel, and is 
assumed from this correlation. 

[0008] The 5th means is characterized by setting a block in order based on the magnitude of the distribution by which said 
block selection means was computed with said distributed calculation means, and choosing the block to predetermined 
sequence in the 3rd means. 

[0009] In the 3rd means, the 6th means is characterized by choosing a block, when said block selection means compares the 
variance and threshold which were computed by said distributed calculation means. 

[0010] the 7th means ™ the 3rd means - setting ~ said division means ~ difference with the contiguity pixel of an attention 
pixel, its direction of an axis of ordinate, and the direction of an axis of abscissa ~ computing ~ each differential signal — 
each shaft orientations ~ being accumulated - a histogram — creating ~ the difference of this histogram to each shaft 
orientations — the center of gravity about a pixel is computed and it is characterized by dividing image data for every block by 
dividing each shaft from this center of gravity. 
[0011] 

[Function] With the 1st means, reverse orthogonal transformation of the multiplier to which the random noise for giving 
fluctuation to an image was added to the multiplier for every frequency by which it was computed by orthogonal 
transformation of the image data having been carried out for every block, and this random noise was added is carried out, and 
image data is restored. Therefore, since fluctuation is given to the frequency component computed by orthogonal 
transformation and fluctuation is stirred by the whole image by reverse orthogonal transformation, with a new configuration, 
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texture can be given to the image which has gradation and it can reproduce. 

[0012] With the 2nd means, random noise is alternatively added to the multiplier of the whole block computed by orthogonal 
transformation or a specific frequency range. Therefore, with a new configuration, the texture of varieties can be given to the 
image which has gradation and it can reproduce. 

[0013] With the 3rd means, distribution of the difference of the attention pixel and contiguity pixel within a block is 
computed for every block, and the block which adds the random noise for giving fluctuation to an image based on this 
distribution is chosen. Since it follows, fluctuation of an amplitude component is given to the field where fluctuation of pixel 
level is dense in a space field and level variation cannot give unnecessary fluctuation to a **** field, texture can be given to 
the whole image and it can reproduce. 

[0014] With the 4th means, the difference of an attention pixel and a contiguity pixel is computed by computing a prediction 
error with a true value by correlation being computed from the plane region of an attention pixel, and the forecast of the 
attention pixel assumed from this correlation being computed. Therefore, the flat part and details of an image field are 
discriminable using correlation between pixels. 

[0015] With the 5th means, a block is set in order based on the magnitude of distribution, the block to predetermined 
sequence is chosen, and random noise is added. Since it can follow, for example, a necessary minimum block can be 
efficiently chosen according to constraints, such as image capacity and transmission capacity, cost can be reduced. 
[0016] With the 6th means, by comparing a variance with a threshold, a block is chosen and random noise is added. 
Therefore, fluctuation level can be changed into arbitration while being able to process by changing a threshold at high speed. 

[0017] with the 7th means, difference with the contiguity pixel of an attention pixel, its direction of an axis of ordinate, and 
the direction of an axis of abscissa is computed, and a histogram creates from each differential signal ~ having » the 
difference of this histogram to each shaft orientations -- the center of gravity about a pixel is computed and an image is 
divided for every block. Therefore, since it is divided for every block based on the description of an image like the flat part of 
an image, or details, texture can be efficiently given to the image which has gradation and it can reproduce. 
[0018] 

[Example] Hereafter, the example of this invention is explained with reference to a drawing. The block diagram showing one 
example of the image processing system which drawing 1 requires for this invention, the explanatory view in which drawing 2 
shows processing of the orthogonal-transformation section of drawing 1 , the explanatory view showing the processing whose 
drawing 3 adds random noise to the multiplier for every frequency of the whole block, the explanatory view showing the 
processing to which drawing 4 adds random noise to the multiplier of a specific frequency range within a block, and drawing 
5 are the explanatory views showing the processing which combined the processing shown in drawing 3 and drawing 4 . 
[0019] In drawing 1 , the image reading section 1 consists of image sensors, such as a scanner and a television camera, reads 
optically the image which has gradation, changes it into an electrical signal, processes a shading compensation etc. and 
outputs. This picture signal is changed into a digital signal by the A/D-conversion section 2, and is temporarily stored in 
memory 3. In addition, this memory 3 is used again, also in case the image output section 8 outputs an image. 
[0020] The image data read from memory 3 is divided by the field block division section 4 for every block field of the pixel 
size of 8x8 and the 2-dimensional field of 16x16, and the orthogonal transformation multiplier (amplitude component of each 
frequency) in each block is computed by subsequently orthogonal transformation processing of DCT (discrete cosine 
transform) etc. being carried out by the orthogonal transformation section 5. In addition, since this processing is conversion to 
a 2-dimensional space field, the transform coefficient generated corresponds to a 2-dimensional frequency domain. 
[0021] In the continuing random-noise adjunct 6, it is restored to the image data by which reverse orthogonal transformation 
of the transform coefficient to which the noise was added to each amplitude multiplier in the frequency domain changed by 
the orthogonal transformation section 5, and this noise was subsequently added by the reverse orthogonal transformation 
section 7 was carried out, and random noise was stirred by the whole. The image with which this image data was outputted to 
the image output sections 8, such as a display and an airline printer, and texture was raised is reproduced. 
[0022] Processing of the orthogonal transformation section 5 is explained to a detail with reference to drawing 2 . If the pixel 
value included in the block is set to P (i, j) to the block field of the space field expressed by x directions and the direction of y 
as shown in drawing 2 (a), as shown in drawing 2 (b), the frequency change within the block will be computed, and each 
amplitude multiplier of the frequency component in the frequency domain expressed more toward the fx direction and the fy 
direction from DC (direct current) component will be computed. 

[0023] Although fluctuation is added to a picture signal by adding random noise to each of this amplitude multiplier in the 
continuing random-noise adjunct 6, addition of this noise is performed per block and the correlation during the block about a 
noise is not generated. Drawing 3 shows the example which adds a noise to the range within [ whole ] a conversion block. 
When [ which add the random noise nmn (m and n are the integer of 0<=m<=2 and 0<=n<=2) of the same size, for example 
to the frequency multiplier Kmn (m and n are the integer of 0<=m<=2 and 0<=n<=2) of 3x3 ] changed by the orthogonal 
transformation section 5 Frequency multiplier Kmn 1 after noise addition (m and n are the integer of 0<=m<=2 and 0<=n<=2) 
is obtained. 

[0024] the inside of the frequency multipliers K00-K22 of 3x3 which drawing 4 showed the example which adds a noise to 
the specific range within a conversion block, and was changed by the orthogonal transformation section 5, and DC component 
- low - the high order component except degree component — receiving ~ random-noise nl -n6 It has added. 
[0025] Therefore, since random noise is stirred by the whole image data by dividing an image for every block, carrying out 
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orthogonal transformation of each block, adding random noise to the amplitude multiplier of each frequency component, and 
carrying out reverse orthogonal transformation of the amplitude multiplier after this noise addition according to the 
above-mentioned example, the image with which texture was raised is reproducible. 

[0026] Each random attached processing shown in drawing 3 and drawing 4 consists of processings shown in drawing 5 
selectable. First, while it is chosen whether a noise is added to the range within [ whole ] a conversion block in the noise 
generation field selection section 3 1 or a noise is added to the specific range, random noise is generated by the appointed field 
of the field of the same size as an image block by the random-noise generation section 32 in a field to the field which the field 
within the block with which a noise is added was chosen, and was chosen by this noise generation field selection section 3 1 . 
[0027] Also in this case, similarly, addition of a noise is performed per block and the correlation during the block about a 
noise is not generated. In the noise adjunct 29, this noise is added to each frequency multiplier 28 within a block, and the 
synthetic multiplier 30 is generated. Therefore, according to this modification, the texture of varieties can be given to the 
image which has gradation and it can reproduce. 

[0028] Below, the 2nd example is explained with reference to drawing 6 - drawing 12 . A flow chart for the block diagram in 
which drawing 6 shows the whole image processing system of the 2nd example, and drawing 7 to explain processing of the 
field division section of drawing 6 , the explanatory view in which drawing 8 shows an attention pixel and its reference pixel 
group, and drawing 9 ~ the difference of drawing 6 ~ the explanatory view showing processing of the generation section - 
The explanatory view in which drawing 10 shows processing of the processing block selection section of drawing 6 , and a 
random-noise adjunct, A flow chart for drawing 1 1 to explain selection processing of the block which adds random noise, and 
drawing 12 are the flow charts for explaining other selection processings of the block which adds random noise. 
[0029] In drawing 6 , first, like the 1st example, the image which has gradation is optically read by the image reading section 
9, and is changed into an electrical signal, and this picture signal is changed into a digital signal by the A/D-conversion 
section 10, and is temporarily stored in memory 11. 

[0030] It is divided into two or more block fields by the field block division section 12 so that the flat part of an image may be 
large and details may become fine by block division according [ the image data read from memory 11 ] to a fixed size, or 
fluctuation long block division based on a pixel consistency. Drawing 7 shows the fluctuation long block division processing 
based on a pixel consistency, deals with the image stored in memory 1 1 two-dimensional first, and computes difference with 
the contiguity pixel of each shaft of a vertical (Y) shaft and a horizontal (X) shaft (step SI). 

[0031] subsequently, each differential signal ~ each shaft orientations -- being accumulated -- a histogram - creating (step 
S2) - the difference of this histogram to each shaft orientations ~ the center of gravity about a pixel is computed (step S3), 
and it divides into a block by dividing each shaft from this center of gravity (step S4). If the required block count is obtained 
repeatedly (step S5) about the divided block, this fluctuation long block division processing will be ended until the required 
block count is obtained in this processing (step S6). Therefore, in this fluctuation long block division processing, it can divide 
for every block based on the description of an image like the flat part of an image, or details. 

[0032] drawing 6 -- return and this example -- difference - the difference of a prediction error is generated by the generation 
section 1 3 from the correlation value of the contiguity pixel of the pixel within a block. Here, there is almost no error of the 
value predicted from the circumference pixel group 32 by the flat part of an image in drawing 8 by correlation between pixels 
and the true value of the attention pixel 33. On the other hand, in the details of an image, correlation with a contiguity image 
becomes weaker and a prediction error occurs. The occurrence frequency increases in a part especially with a large amplitude 
change. Therefore, fluctuation can be given to an image when distribution of these error components adds random noise to a 
large block. 

[0033] In the example shown in drawing 8 , forecast X' of the attention pixel 33 is computed as follows to the true value X of 
the attention pixel 33 from each values A, B, and C of the left, the upper left, and three upper reference pixel groups 32. 
[0034] X -A-B+C ~ here, when a value belongs to the image field where both the each reference pixel 32 of A, B, C, and X 
and attention pixels 33 are flat, forecast X' of the attention pixel 33 also almost becomes these values A, B, C, and X, and 
when another side and the attention pixel 33 belong to the details of an image, the value X turns into a value which is different 
in each values A, B, and C of the reference pixel 32. 

[0035] drawing 9 - referring to ~ difference -- explanation of processing of the generation section 13 computes forecast X 1 of 
the attention pixel 33 with reference to the circumference pixel group 32 of the attention pixel 33 first. Subsequently, 
difference with the true value X of this forecast X' and the attention pixel 33 is computed, and this prediction error is 
computed for this difference about each block as a prediction error of that block. In addition, in predicting the boundary of a 
block, it uses the pixel of other blocks as a reference pixel. 

[0036] again — drawing 6 ~ return and the continuing distributed calculation section 14 - the above within each block ~ 
distribution of difference is computed, and in the processing section block selection section 15, the block with which a noise 
is added based on distribution of each block is chosen, subsequently to this selected block, random noise is added by the 
random-noise adjunct 16, and it is outputted to the image output section 17. 

[0037] With reference to drawing 10 - drawing 12 , processing of the processing block selection section 15 and the 
random-noise adjunct 16 is explained. Two lines, the image with which random noise was added to the block image, and the 
image which is not added, are generated, moreover, the above within each block ~ distribution of difference is computed, the 
switch signal of the two above-mentioned images is generated based on this distribution, and the block image with which a 
noise was added or is not added is generated. 

[0038] Drawing 1 1 shows the processing generated in order of the magnitude of distribution of the above-mentioned switch 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cg 



signal. First, the distribution about the prediction error of the true value X of each pixel within each block and forecast X' is 
computed (step SI 1), and this distribution is computed about a whole block (step S12). Subsequently, the size relation of 
distribution of this the block of each is compared, ranking of each block is carried out (step SI 3), and noise additional 
information is created to the block which needs to add a noise (step SI 4). 

[0039] Therefore, according to this approach, since a necessary minimum block can be efficiently chosen, for example 
according to constraints, such as image capacity and transmission capacity, cost can be reduced. 
[0040] Drawing 12 shows the processing which generates the above-mentioned switch signal based on the threshold of 
distribution. First, the distribution about the prediction error of the true value X of each pixel within each block and forecast 
X' is computed (step S21), and noise additional information is created to the block which has bigger distribution than this 
threshold for this distribution as compared with a threshold (step S22) (step S23). Therefore, fluctuation level can be changed 
into arbitration while being able to process by changing a threshold at high speed. 

[0041] Therefore, since according to this 2nd example fluctuation of an amplitude component is given to the field where 
fluctuation of pixel level is dense in a space field and level variation cannot give unnecessary fluctuation to a **** field, 
texture can be given to the whole image and it can reproduce. 
[0042] 

[Effect of the Invention] As explained above, in invention according to claim 1 As opposed to the multiplier for every 
frequency by which it was computed by orthogonal transformation of the image data having been carried out for every block 
Since reverse orthogonal transformation of the multiplier to which the random noise for giving fluctuation to an image was 
added, and this random noise was added is carried out and image data is restored Texture can be given to the image which 
fluctuation is given to the frequency component computed by orthogonal transformation, and fluctuation is stirred by the 
whole image by reverse orthogonal transformation, therefore has gradation with a new configuration, and it can reproduce. 
[0043] In invention according to claim 2, since random noise is alternatively added to the multiplier of the whole block 
computed by orthogonal transformation or a specific frequency range, with a new configuration, the texture of varieties can be 
given to the image which has gradation and it can reproduce. 

[0044] In invention according to claim 3, since the block which adds the random noise for distribution of the difference of the 
attention pixel and contiguity pixel within a block being computed for every block, and giving fluctuation to an image based 
on this distribution is chosen, fluctuation of an amplitude component is given to the field where fluctuation of pixel level is 
dense, for example in a space field, and level variation cannot give unnecessary fluctuation to a **** field. Therefore, texture 
can be given to the whole image and it can reproduce. 

[0045] In invention according to claim 4, since the difference of an attention pixel and a contiguity pixel is computed by 
computing a prediction error with a true value by correlation being computed from the plane region of an attention pixel, and 
the forecast of the attention pixel assumed from this correlation being computed, the flat part and details of an image field are 
discriminable using correlation between pixels. 

[0046] In invention according to claim 5, since a block is set in order based on the magnitude of distribution, the block to 
predetermined sequence is chosen and random noise is added, for example according to constraints, such as image capacity 
and transmission capacity, a necessary minimum block can be chosen efficiently, therefore cost can be reduced. 
[0047] In invention according to claim 6, since a block is chosen and random noise is added by comparing a variance with a 
threshold, while being able to process by changing a threshold at high speed, fluctuation level can be changed into arbitration. 

[0048] In invention according to claim 7, difference with the contiguity pixel of an attention pixel, its direction of an axis of 
ordinate, and the direction of an axis of abscissa is computed, a histogram creates from each differential signal - having ~ the 
difference of this histogram to each shaft orientations, since the center of gravity about a pixel is computed and an image is 
divided for every block Texture can be efficiently given to the image which is divided for every block based on the 
description of an image like the flat part of an image, or details, therefore has gradation, and it can reproduce. 



[Translation done.] 



